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Objective:  Extend  forecasting  from: 


•  Deterministic  (single  forecast)  to  stochastic  (probabilistic)  in 

•  Space  (from  regional  to  global)  and 

•  Time  (from  -7  days  to  -30-60  days) 

•  Via  ensemble  modeling 


Objective:  Extend  forecasting  from: 


•  Deterministic  (single  forecast)  to  stochastic  (probabilistic)  in 

•  Space  (from  regional  to  global)  and 

•  Time  (from  ~7  days  to  -30-60  days) 

•  Via  ensemble  modeling 

Outline: 

•  Initial  capability  based  on  NCOM  in  Gulf  of  Mexico 

•  Preliminary  Global  “ensembles  of  opportunity” 

•  Proposed  global  ensemble  forecasting 

•  Based  on  HYCOM 

•  Unique  and  specific  challenges 


RELO  NCOM/NCODA 


NCODA  -  NRL  Coupled  Ocean  Data  Assimilation  -  Cummings,  QJRMS,  2005 
NCOM-  Navy  Coastal  Ocean  Model  -  Barron,  et  al.,  Ocean  Modeling,  2006 
COAMPS  -  Coastal  Ocean  Atmosphere  Mesoscale  Prediction  System 

•  3km  grid  /  49  levels  (33  sigma,  16  z) 

•  NRL  DBDB2’  bathymetry 

•  COAMPS  27km  forcing 

•  Lateral  BCs  by  G-HYCOM  (GOFS  3.0) 

•  OSU  OTIS  tides  at  boundaries 

•  Assimilates  data  from  any  source  available  in  real-time 

•  Satellites  (SST,  SSH) 

•  In  situ  obs  (XBTs,  CTDs,  floats,  buoys  gliders,  ships) 


3D  Forecasts  to  72  hours/60  days 
•  T,  S,  currents,  elevation 


9b°W  90°W  8b°W  80°W  9b°W  90°W  85°W  80°W 


Analysis  valid  on  8  Jan.  2013  60  day  (Mar.  9)  forecast  from  8  Jan.  Analysis 

Control  run  no.  1 :  Produces  a  3  day  forecast  once  per  day 

(assimilate  local  profile  observations  only,  24  hr  window) 

Control  run  no.  2:  Produces  a  60  day  forecast  once  per  week 

(assimilate  synthetic  and  observed  profiles,  7  day  window) 

Note:  60  day  forecasts  required  the  construction  “high-frequency”  climatological 
forcing  files  (more  realistic  spatial  and  temporal  variability  than  persistence 
or  seasonal/annual  climatology) 

e.g.  2003-2012;  10  records  for  Jan  1  OOOz,  003z,  006z...  -  Dec.  31  021  z 


Oil  Map  integrating  NO AA  calibrated  estimates 
and  actual  observations 


Why  Ensembles? 


May  21  Louisiana  officials  close  more  shore  and  marsh  areas  as  more  oil  is  discovered. 
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Map  Estimated  extent  of  oil  on  surface  Fishing  ban  Marshes  ■  Reports  from  locations  where  oil  has  made  landfall 

Key  Surveyed  extent  Loop  current  K3  Urban  areas  [g]  For  updates,  follow  us  on  Twitter  @nytoilspillmap. 


•  Deterministic  forecast  only  captures  one  possible 
trajectory  and  will  likely  diverge  from  reality  esp. 
for  extended  range  forecasts 

•  Done  properly,  ensemble  will  include  the  true  state 

•  Ensemble  provides  the  forecast  error/uncertainty 

•  Ensembles  can  be  calibrated  to  refine  the  forecast 


May  21 , 201 0  Control  Run 

Log  10  CONCENTRATION  MAP  -  RELO/NCOM  Control  Run 
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May  21 , 201 0  Ensemble  Mean 

Log  10  CONCENTRATION  MAP  -  RELO/NCOM  Ensemble  Mean 
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Color  bar  is  concentration  and  is  correlated  to  thresholds  from  BONN  agreement  for  oil  appearance  code 


Ensemble  Approach  to  Quantifying  Ocean  Uncertainty 


SST:  Ship,  Buoy,  AVHRR 
(GAC/LAC),  GOES,  AMSR- 
E,  MSG,  AATSR 

Temp/Salt  Profiles:  XBT, 
CTD,  Argo  Float,  Buoy 
(Fixed/Drifting),  Gliders 

SSH:  Altimeter,  T/S 
profiles 

Sea  Ice:  SSM/I 


Ocean  QC 


novations 


3D  Var 


Incremental 
update  cycle 


-  Coelho  et  al,  "Targeting  observations  to  reduce 
acoustic  prediction  uncertainty"  ,  ONR  Journal  of 
Underwater  Acoustics,  2010 
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Ensemble  Transform  (ET)  -  Bishop  and  Tooth  (1999) 


Forecast  & 
Error 

Uncertainty 


The  spread  and  growth  of  the  Initial  Condition  (the  perturbations) 
is  determined  by  the  forecast  error  variance  via  the  Ensemble  Transform 

Analysis  error  estimate  -  standard  dev.  of  the  ensemble  set 

Uncertainty  -  described  through  the  PD  of  state  parameters  through  the  ensemble 


Ensemble  Fields  for  16  Jan.  2013  (the  analysis) 

Calculated  over  20  ensemble  members 


SST  (°C),  Mean  SSS  (psu),  Mean  MLD  (in),  Mean 
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Ensemble  Forecasting  Concept  of  Operations  (CONOPS) 


24  hour  forecasts  are  run  daily, 

8-week  forecasts  are  run  every  weekly  (Sunday) 


To  Date: 

Jan.  27  -  Mar.  24 
Feb.  03  -  Mar.  31 
Feb.  1 0  -  Apr.  07 
Feb.  17  -  Apr.  14 
Feb.  24 -April  21 
Mar.  03  -  Apr.  28 
Mar.  1 0  -  May  05 
Mar.  17 -May  12 
Mar.  24  -  May  1 9 
Mar.  31  -  May  26 
Apr.  07  -  Jun.  02 
Apr.  14  -  Jun.  09 
Apr.  21  -  Jun.  16 
Apr.  28  -  Jun.  23 
May  05  -  June  30 


•  Currently  running  on  NRL  Linux  Cluster 

•  32  ensemble  members 

•  Daily  run:  96  CPUs,  ~  2  hours 

•  Weekly  run:  120  CPUs  for  5  members,  ~3.5  hours 
(32  members  takes  ~21  hours) 

•  Each  member  ~4.2  GB  in  netCDF  format 

(~  135  GB  for  60-day  32  member  ensemble  once  per  day) 

• Will  eventually  run  at  Naval  Oceanographic  Office 
(but  stringent  transition  process  and  CONOPS) 


January  27  Analysis  with  ensemble  std.  dev.  (color)  and  25  °C  ensemble  mean 
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22°C  at  100-m  (contour),  Ens  Mean,  Mean  (shaded) 
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GoM  Ensemble  Modeling 
March  17  Analysis  and 
60-day  forecast 
(12  May  2013) 
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Risk  Assessment  for  Planning  and  Operations 


Weighs  the  likelihood  of  occurrence  (probability) 
with  the  severity  of  risk  (impact  threshold) 


Objective:  Identify  areas  and  periods  in  the  GOM  over  a  60  day  long 
forecast  where  environmental  conditions  might  produce  operational  impacts 


•  Operations  Safety/Warning  System 

Variables:  surface  currents,  vertical  shear,  wind,  sea-state,  SST,  etc. 
Thresholds:  magnitude  levels  that  will  impose  risk  on  operations, 
relative  weighting  and  identification  of  individual  critical  levels  (small 
boats,  drill  stems,  etc.) 


Operational  Safety/Warning  System 


Impacts/Thresholds  Examples 

•  Surface  Ocean  Currents: 

very  high  impact  if  above  0.7m/s;  high  impact  if  above  0.5m/s  and  below  0.7m/s;  moderate  impact  if 
between  0.25  and  0.5m/s;  low  impact  if  above  0.15m/s. 

•Surface  Winds  : 

very  high  impact  if  above  3  Om/s;  high  impact  if  above  20m/s;  moderate  impact  if  above  lOm/s;  low 
impact  if  above  5m/s; 

•Sea  State: 

very  high  impact  if  above  3m;  high  impact  if  above  2m  ;  moderate  impact  if  above  1m;  low  impact  if 
above  0.5m. 


Ensemble  Approach  to  Ocean  Forecasting 


Single-Model  Approach: 

Use  one  forecast  system  and  perturb  some  aspect  of  that  system  (initial  state 
and  atmospheric  forcing)  then  integrate  forward  to  obtain  a  forecast. 

Temp.  100m,  Mean  Temp.  100m,  Var 

N  different  ensemble  realizations 

Note:  Ensembles  take  N  members 
as  much  computer  time 

Pro:  develop  one  model 
Con:  do  perturbations  represent 
reaslistic  variance? 
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Ensemble  Approach  to  Ocean  Forecasting 


Single-Model  Approach: 

Use  one  forecast  system  and  perturb  some  aspect  of  that  system  (initial  state 
and  atmospheric  forcing)  then  integrate  forward  to  obtain  a  forecast. 
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N  different  ensemble  realizations 

Note:  Ensembles  take  N  members 
as  much  computer  time 

Pro:  develop  one  model 
Con:  do  perturbations  represent 
reaslistic  variance? 


Multi-Model  Approach: 

Use  forecast  systems  with  different  designs  (physics,  resolution, 
forcing,  etc.),  typically  run  by  different  operational  centers  or  labs 


Temp.  100m,  Mean  Temp.  100m,  Var 


95°W  90°W  85°W  80°W  95°W  90°W  85°W  80°W 


N  different  forecast  systems 

Pro:  more  variety  across  members 
Con:  limited  number  of  members 


Multi-Model  Comparison:  Sea  Surface  Height 

11  Feburary2013 
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Multi-model  Ensemble 


Ensemble  of  5  Model  Runs  for  20100701000 
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32-member  Single  Model  Ensemble 

Ensemble  of  32  Model  Runs  for  2010070100,  3-Km  RELO 
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Global  "Ensembles  of  Opportunity" 


There  were  several  global  experiments  with  ~3  month  overlap  that 
were  run  as  part  of  the  normal  development  and  improvement  process 
such  that  the  global  simulations  that  differ  by  some  parameter  setting 
or  technique. 


Not  the  proper  way  to  develop  and  configure  an  extended  range  forecast 
capability  (more  on  that  soon). 

Set  1  (2007):  5  used  Cooper-Haines,  3  used  MODAS  synthetics.  Two  used 
35  layers  instead  of  27.  Some  used  an  updated  version  of  NCODA  and  one 
used  mixed  layer  depth  to  modify  the  MODAS  synthetic,  etc.) 


Set  2  (2012):  All  3DVar,  32  vs.  41  layers,  different  ocean  analysis  configurations 


SSH:  Global  Ensemble  Variance  vs.  Time  Variance 


80°N 

60°N 

40°N 

20°N 

0° 

20°S 

40°S 

60°S 

80°S 


SSH  (m),  Std.  Dev.,  Ensemble  of  8  Members  for  20070731 


1 00°E  1 50°E  1 60°W  110°W  60°W  10°W  40°E 


80°N 

60°N 

40°N 

20°N 

0° 

20°S 

40°S 

60°S 

80°S 


SSH  (m),  Std.  Dev.,  GLBa0.08,  90.9,  2008-2011 
—  I  I  I  I  I  I 
0.02  0.04  0.06  0.08  0.1  0.3 


1 00°E  1 50°E  1 60°W  110°W  60°W 


SSH  variance  calculated 
over  8  different  models 
on  31  July  2007. 

Uncertainty  due  to  errors 


SSH  variance  calculated 
from  one  simulation 
over  2008-2011 . 
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SSS:  Global  Ensemble  Variance  vs.  Time  Variance 


SSS  (psu),  Std.  Dev.,  Ensemble  of  8  Members  for  20070731 
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SSS  variance  calculated 
over  8  different  models 
on  31  July  2007. 

Uncertainty  due  to  errors 
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SSS  variance  calculated 
from  one  simulation 
over  2008-2011 . 
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SST:  Global  Ensemble  Variance  vs.  Time  Variance 


SST  (°C),  Std.  Dev.,  Ensemble  of  8  Members  for  20070731 
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SST  variance  calculated 
over  8  different  models 
on  31  July  2007. 

Uncertainty  due  to  errors 


SST  (°C),  Std.  Dev.,  GLBa0.08,  90.9,  2011,  Anomaly 
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SST  variance  calculated 
from  one  simulation 
over  2008-2011 . 

Amplitude  of  the  annual 
cycle  removed 
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SST:  Global  Ensemble  Variance  vs.  Time  Variance 


SST  (°C),  Std.  Dev.,  Ensemble  of  7  Members  for  20120415 
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SST  (°C),  Std.  Dev.,  Ensemble  of  8  Members  for  2007C 
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Experiment  25.0  excluded 


from  one  simulation 
over  2008-2011. 


Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 


Stochastic 

parameterization 


Sources  of  uncertainty 

Localization  of 
Ensemble  Trans. 


Post  calibration/ 
Bias  correction 


Science  objectives: 

•  Account  for  the  relevant  sources  of  uncertainty  on  an  ocean 
ensemble  forecast. 

•  ET  global  /  banded  appropriate  for  atmosphere,  not  ocean 

•  Reduce  enormous  information  content  in  ensemble  to  a  best 
forecast  through  Maximum  Likelihood  estimate 

•  Calibrate  ensemble  for  bias  /  drift  through  use  of  observations 

•  Testing,  benchmarking,  demonstration  of  skill 


Maximum 
Likelihood  Estimates 


New  extended 
range  forecast 


Testing  and  Demo 


Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 


Stochastic 
parameterization 

Sources  of  uncertainty 


Localization  of 
Ensemble  Trans. 


The  challenge  is  to  account  for  neglected  or  ill-represented 
processes  in  the  deterministic  models  associated  with  subgrid 
scale  processes. 

This  can  lead  to  insufficient  ensemble  spread  needed  to  capture 
the  true  forecast  or  even  to  encompass  climatology  for  longer- 
range  forecasts,  as  well  as  insufficient  forecast  error  variance 
over  the  length  of  the  forecast. 


Post  calibration/ 
Bias  correction 
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123°W  122°  30  122°W  121°  30 


Here  the  model 
errors  are  modeled 
using  unbiased 
random  noise  with  a 
n  exponential 
decorrelation  in  time 
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Transport  Streamfunction  (Sv) 
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Salinity  (PSU)  at  30  m 
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Differences  between  a  deterministic  and 
Stochastic  1  -day  forecast  started  from  same 
Initial  condition  (Lermusiaux,  2006). 
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New  extended 
range  forecast 


Testing  and  Demo 


Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 
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Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 


Stochastic 

parameterization 


Sources  of  uncertainty 


Localization  of 
Ensemble  Trans. 


Post  calibration/ 
Bias  correction 


Challenge:  To  account  for  global  vs.  local  biases 
in  key  variables  and  optimize  spread  skill  over  regions 
and  variables  of  interest. 


This  can  be  done  via  Bayesian  Analysis  using  the  local 
NCODA  analysis,  other  sources  of  information  (regional 
runs  if  available),  and  climatology  as  constraints  to  compute 
the  likelihood  functions  from  the  prior  ensemble  population. 


Posterior 

P(x\y°)  = 


Likelihood 

Function 

P(y“\x) 


p(y“) 


Prior 

xp(x) 


x  =  ocean  state 

p(x)  =  global  ensemble  distribution 
ya  =  constraints  from  other  sources 


Maximum 
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New  extended 
range  forecast 


Testing  and  Demo 


Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 


Stochastic 

parameterization 


Sources  of  uncertainty 


Localization  of 
Ensemble  Trans. 


Post  calibration/ 
Bias  correction 


Challenge:  To  extract  the  best  forecast  and  indentify  the  key  variables 
That  are  influencing  the  forecast. 

This  is  done  by  generating  joint  PDFs  from  ensemble  populations 
that  have  a  large  number  of  degrees  of  freedom  relative  to  the 
ensemble  size. 


Joint  PDFs  are  constructed  statistically,  i.e. 

•  Parametric  estimation  (e.g.  using  mean  and  error  covariances) 

•  Kernel  Density  Estimation 

•  Gaussian  Mixture  Models 


Maximum 
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New  extended 
range  forecast 


Testing  and  Demo 


Objective:  Extend  the  Range  of  Ocean  Forecasts  in  Space  (up  to  global) 
and  in  time  (up  to  30  days)  using  a  stochastic  forecast  capability 


Stochastic 
parameterization 

Sources  of  uncertainty 

Localization  of 
Ensemble  Trans. 


Post  calibration/ 
Bias  correction 


Challenge:  To  extract  the  best  forecast  and  identify  the  key 
variables  that  are  influencing  the  forecast. 

Done  by  identifying  local  and  global  maxima  in  the  Joint  PDFs. 

The  JPDFS  are  complex  functions  (high  dimensionality),  thus 
they  require  the  exploitation  of  robust  algorithms  to  search  out 
these  inflection  points 

Complex  algorithms  to  be  explored  include: 

•  gradient  analyses  of  PDFs 

•  steepest  decent 

•  genetic  algorithms 

The  maximum  likelihood  estimate  and  probability 
of  joint  occurrence  will  be  used  to  extract  the 
maximum  likelihood,  which  will  give  a  more  accurate 
forecast  than  the  any  of  the  ensemble  members, 
the  ensemble  mean,  or  the  deterministic  (control  run) 
mean. 


Color  =  likelihood  (0-1) 

White  =  observed  mean  error 
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New  extended 
range  forecast 


Testing  and  Demo 
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8-Week  Ensemble  Forecast 


Analysis:  March  10 


SSH  (m),  A=201 30310,  F=201 30310,  32-Members 
0.17m  at  000-m  (contour),  Ens  Mean,  Mean  (shaded) 


Altimetry:  March  10 


Realtime  Mesoscale  Altimetry  -  03/10/2013 
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Analysis:  March  10 


SSH  (m),  A=201 30310,  F=201 30310,  32-Members 
0.17m  at  000-m  (contour),  Control,  Ens  Mean,  Std.  Dev.  (shaded) 
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SSH  (m),  A=201 30310,  F=201 30505,  32-Members 
0.17m  at  000-m  (contour),  Ens  Mean,  Mean  (shaded) 
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Realtime  Mesoscale  Altimetry  -  05/05/2013 
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Forecast:  May  05 


Altimetry:  May  05  Forecast:  May  05 


8-Week  Ensemble  Forecast 


Analysis:  April  21 


SSH  (m),  A=201 30421,  F=201 30421,  32-Members 
0.17m  at  000-m  (contour),  Ens  Mean,  Mean  (shaded) 
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Altimetry:  April  21 


Realtime  Mesoscale  Altimetry  -  04/21/2013 


Analysis:  April  21 
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SSH  (m),  A=201 30421,  F=20130616,  32-Members 
0.17m  at  000-m  (contour),  Ens  Mean,  Mean  (shaded) 
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Altimetry:  May  6 

Realtime  Mesoscale  Altimetry  -  05/06/2013 


Altimetry:  June  16??? 
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Forecast:  June  16 


Forecast:  June  16 
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